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Discussed are research methods used to measure 
developmental changes in children's reasoning about ability. While 
adults generally differentiate ability, effort, luck, and task 
difficulty as causes for success and failure, children progressively 
think that effort or outcome is ability (level 1), that effort is the 
cause of performance outcomes (level 2), that effort and ability are 
partially different (level 3), and that ability is capacity (level 
4). Typically, level 1 thinking predominates among 5-year-old 
children, while most children advance to level 4 at about 11 or 12 
years of age. Techniques used to identify and assess developmental 
levels in children's reasoning about ability required subjects to 
compare the abilities of two children who applied varied levels of 
effort and achieved varied outcomes. In initial studies, films or 
videotapes were shown individually to subjects. Later research used a 
series of six pictures frequently depicting one child "goofing off.** 
This report illustrates and discusses enamples of children's typical 
response protocols at each level of reasoning, reports rationale for 
key questions asked in the interview situation and for scoring 
procedures, and explores the relationship of reasoning level to other 
variables, such as expectations of teacher approval for effort and 
performance impairment after failure. (RH) 
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Achievement motivation is distinguished from other forms of 
motivaticn by the incentives associated with it. The incentive 
for achievemant is competence or the perception of competence 
Csee Nicholls, 13B4; Nicholls 8. Miller, 13B4a for discussion?. 
Ule make judgements about competence based upon our schemes or 
conceptions of ability. Thus, variation in achievement 
motivation will result from variations in reasoning about 
ability. It follows that the development of the concept of 
ability is central to the development of achievement motivation. 

We Csee Nicholls S Hiller, 13B4a for review) focused 
attention on conceptions of ability in the context of other 
factors to which people attribute success and failure. Adults 
generally distinguish or differentiate ability, effort, luck, 
and task difficulty as causes for success and failure CUeiner, 

. Children, on the other hand, use these concepts 
differently. The following is a discussion of methods we have 
used to measure developmental changes in understanding of effort 
and ability . 
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Reasoning about Effort and Ability 

Four levels of reasoning about effort and ability luere 
identified CNicholls, 137B; Nicholls S Miller, 13a4b) . A 
description of these levels appears in appendix A, 

The technique used to identify and assess levels of 
reasoning about ability utilizes a situation luhere the child 
must compare the abilities of children luho apply varied levels 
of effort and achieve varied outcomes. In the first tuo 
studies, films or videotapes luere shouun to the child with tuo 
children uorking on the same task shouuing obvious differences in 
level of effort., As an alternate form, later research used a 
series of pictures depicting tuuo children uorking on a task, 
uith one child "goofing off" in four of the six snapshots 
Cniller, 1385). 

While it is someuuhat more realistic for children to make 
judgements about films or videotapes of actors, the pictures 
hold several advantages. The child's level of reasoning can be 
assessed more quickly Cabout 5 minutesD using pictures. It is 
also quite helpful for children to be able to refer to the 
pictures and the differences in effort uuhile discussing 
outcomes. This is especially true uuith younger children uho may 
doubt their memory uuhen events have unexpected outcomes Ce.g., 
louer effort resulting in higher performance). 

Regardless of the method of presentation of stimuli, 
children vieiu tuuo students ujorking on the same task for the same 
amount of time and attaining the same score. A variation uith 
the harder uorker getting a louer score is necessary if one is 
to distinguish level 1 from level S reliably CNicholls, 137BD . 
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The folloujing are some descriptions of typical response 
protacGls. Generally, a child who Fully understands capacity 
CLevel can be identified readily. In the Folloujing interview 
our standard interview questions only were used and the student 
is logically consistent in her responses. 

^^Is one smarter at these puzzles or are they the same?^^ 

"This C lazier 3 one is smarter »" 

"Ho)^ can you tell?" 

"She looked around hut got the same number rights 

"Hoy^ come they both got the same score y^hen one y^orked hard 

and one didn't y^ork hard?" 

"This one C lazier J y^as smarter," 

"Nhat y^ould happen if they both y^orked hard? Mould one get 
more or y^ould they both get the same?" 
"This one C lazier J y^oald get more," 
"Hoy^ can you tell?" 

"The other one already tried hard*" 

"So do you think one of them is smarter?" 

"Her ClazierJ," 

This is a clear example oF complete diFf erentiation oF the 
concepts oF eFFort and ability Csee level 4, Appendix AD. A 
signiFicant proportion oF the students who initially give the 
impression that they lack the insights illustrated in the above 
interview, "wake up" aFter being asked, "How come they got the 
same . . .?» CNicholls S Miller, 19B4bD . For example: 
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"Is one smarter at these puzzles or are they the same?" 

"The same.'' 

"Hoy^ can you tell?" 

"Since they got the same score." 

"Hohf come they both got the same score y^hen one y^orked hard 
and one didn't yfork hard?" 

"He C lazier one J didn't have to think as hard to get the 
ansj^ers. " 

"Nhat y^oald happen if they both yforked really hard? Noald 

one get more or yfould they both get the same?" 

"He'd C lazier one J do more." 

"Hoy^ can you tell?" 

"Because he got them quick.'' 

"So do you think one of them is smarter?" 

"They're the same. Nellj, he ClazierJ is probably a little 
smarter cause he figures cut the problems easier." 

Others give the impression that they are about ta wake up 
Cand thereby be categorized as level but do not, even when 
the interview is repeated with film or photos of different 
children . 
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"I<r one smarter?'^ 
"They're the same.'' 
"Hoy^ can yoa tell?'' 
''Cause they both got JO." 

"Hohf come they both got the same score Nhen one y^orked hard 
and one didn't?" 

"Maybe he ClazierJ is smart bat playing around." 

"Nhat hfoald happen if they both hforked really hard? Noald 

one get more or wo aid they get the same?" 

"Same." 

"Hoy^ can yoa tell?" 

"If the one playing around yfoald ha^'e tried j, he woaid get 

the same* He y^oaldn' t get j^orse^^" 

"So do yoa think one of them is smarter?" 

"They're the same." 

Although the student gave a hint of differentiation of 
effort and ability, ujhere the lazier actor is seen as "smart but 
playing around," this indication uuas not sustained. This 
illustrates level 3 in that the student showed a glimmer of 
understanding that the effect of effort on performance depends 
upon individual differences in ability. But such glimmers are 
absent in many cases. For example: 
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'Is one of them smarter or are they the same?" 
"This onv> Charder hforkerJ is," 
''Hoy^ can you tell?" 
"He's doing his y^ork,/' 

''Hoy^ come they both got the sajite score Nhen one i^orked hard 
and the i*tf7er one didn't y^ork hard?" 
He Clazy oneJ copied^' 

Nell^^ yes^^ that someti mes happens^^ oat we didn't yjant to 

shc^ yoa anyone y^ho copies and this hoy doesn't do that." 

''He Clazy one J mast ha^'e thoaght ahoat it." 

"Hhat y^oald happen if both y^orked really hard? Moald one 

get more or y^oald they both get the same?" 

''The same." 

"Hoy; can yoa tell?" 

''If they both yjork hard and they are good Norkers they can 
get it done," 

"So do yoa think one of them is smarter," 

"They are the same. Both are smart becaase they both got 
their y^ork done and they both got eight right," 

Biven the above inf Drmatian, it is hard to be sure whether 
this interview illustrates level one or level two^ It seems 
that the student expects equal effort to lead to equal results 
Cdespite the difference in effort that he acknowledged at the 
outset of the interview:). find, where scores are equal he tries 
to account for this in terms of equal effort--by suggesting that 
the boy who was Cor seemedD lazy actually thought about the 
ujork. It seems that this child differentiates effort as a cause 
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From DutcamBs and thus illustrates level E. But it is hard to 
be sure whether he simply expects effort and performance to be 
correlated as do level 1 students-. To provide a better test of 
the differentiation of the concept of effort as a cause from 
outcomes, a further problem was used. In this the harder worker 
solved 5 out of 10 and the lazier student scored 8 CNicholls, 
137B; Nicholls et al . , in press?. Here is how the above child 
dealt with this additional problem. 

^^Is one of them smarter?^^ 

''He C lazier f higher scorer J is^'' 

''Hok^ can you tell?'' 

"He got e and he got 2.'* 

"Hoy^ come the one y^ho didn't y^ork so hard got more right?'' 
"This C lazier J one is smarter." 
"Hhat does that mean?" 
"He knohfs more." 

"Hhat woaid happen if they both y^orked really hard . . . yfoald 
one get more...?" 
"They'd get the same." 
"Hoy^ can you tell?" 

"If they both y^orked hard and listened they'd get the 
same. " 

"So do yoa think one of them is smarter?" 

"Him ClazierJ." 

This boy still expected equal effort to lead to equal 
outcomes, despite the fact that ujb had just showed him a blatant 
violation of this rule. But he acknoujledged the fact that it 
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doBsn't always follouj. That is, effort and □utcomes are not 
confounded to the extent that they are at the least 
differentiated level. This .least differentiated position is 
illustrated by the following partial protocol from a girl whose 
responses to the initial situation Ciuhere the actors scored the 
same as each other) luere almost identical to those of the 
previous student. But, when shown the harder worker scoring S 
and the lazier student scoring B, she chose the harder worker as 
more able because "She is working and not playing." 

"Ho)^ come the or>e '^ho didn't y^ork so hard got more right?^' 

"She got real busy after she y^as playing around 

"Hon come she Cthe one hfho ^forked lessJ got more than the 

other one?'^ 

"She y^orked harder »" 

"Nhat k^oald happen if they both hforked really hard Nould 

one get more,»»'?" 
"Get the same." 
"Hoy^ can you tell?'' 
"They'd both be y^orking 

"So do you think one of them is smarter?" 

"She C harder NorkerJ is." 

This response has a hint of level E reasoning in that the 
girl implies that harder work causes higher scores. But the 
evident difficulty with the notion that a harder ujorker might 
score less or be less able is typical of level 1. It suggests 
that when effort and outcome do not go together, the child 
appears unable to accommodate this. It is not that level 1 
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children don't recognize the discrepancy at some level. Many of 
them express surprise mingled with outrage when they observe Cin 
the Film or videotape:) that the student they were told scored 
more is "goofing off." Cries of "What!" "Huh!" and such 
indicate both their expectations about the world and the fact 
that they recognize a violation of this expectation. But this 
recognition does not lead them to say that the harder luorker 
gained a lower score and is less able as do level E students. 

One always finds a few protocoJs that contain elements of 
mare than one level. This is hardly surprising. If meanings 
are constructed through a process of detecting and resolving 
cantradictians between one's schemes and between these schemes 
and one's perception of the world, periods of confusion and 
inconsistency are inevitable. Despite this, it is relatively 
easy to categorize protocols into the four levels with a high 
level of agreement between independent raters CMiller, 13B5 ; 
Nicholls, 137B; Nicholls & Miller, 19B4b; Nicholls, Patashnick, 
& Hettetal , 13BB3 . 

Scoring is made much easier if as protocols are categorized 
based upon the overall interview, they are placed in piles — one 
far each level and CusuallyD extra piles For the undecided 
ones. nn going through protocols in these piles, one at a time, 
it becomes increasingly easy to see the protocols that don't 
belong and those that do. This makes scoring much easier and 
more reliable than if you try to Judge each one on its own. Ue 
typically go through each pile several times before being 
satisfied that we have obtained the best categorization 

II 



riaasuring understanding af ability 

-11- 

possible. Us have always had two people complete the 
categorization independently and then we take an additional look 
at those where there is disagreement. 

Most important to obtaining categorizable protocols is the 
ability to conduct the- intervieiu in a fashion that insures 
subjects respond meaningfully to the questions. If the child 
gives a nonsensical or unclear response or fails to respond to 
the stimuli, it may be necessary to ask probing questions to 
insure that the child is reasoning about the scenario as it is 
intended. Thus, careful attention to responses to each question 
is warranted. 

1) "Is one of these children working harder, or are they working 
the same?" 

This question is asked primarily to . insure that children 
register the information in the intended fashion. UJe cannot 
begin the interview if there is any confusion about which child 
tried harder. On infrequent occasions when children fail to 
respond accurately to this question, probing questions such as 
"Who was working hardest in this picture? In this one?" are 
asked to insure that children correctly interpret the stimuli. 

2) "Is one of them smarter at the puzzles or are they the 
same? How can you tell?" 

This question provides the first major piece of information 
regarding the information the child uses to infer cbilitr. The 
level 1 child centers on the most apparent difference in the 
children that is related to being smart. Generally, they thus 
Judge the hard worker to be smarter. Less commonly, they may 
focus on outcome or even size CShe is smarter cause she's big). 
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The level S child expects equal effort to result in equal 
outcomes. Trying to ignore either the level af effort or the 
outcome, they judge the two to be the same or that the hard 
worker is smarter because hard work leads to getting things 
right. 

Children at level 3 and 4 will generally note that equal 
performance uiith less effort implier greater ability, although 
level 3 children will do so less consistently. 

3D "How come they both got the same score when this one worked 
hard and this one didn't?" 

This is probably the most critical question for 
distinguishing levels 2, 3 and 4. The child at level 2 is 
confronted with a problem which contradicts his/her conception 
of ability and effort. Frequently, the child will try to deny 
the apparent differences in effort CThis girl worked real hard 
here.) or try to escape the problem CShe cheated D. The 
interviewer should not allow the child to escape the 
contradiction without confronting it, and thus an appropriate 
response might be, "Uell that sometimes happens, but in this 
case we are certain that neither child cheated. 

Because this question cannot be adequately answered with 
level 2 reasoning, it promotes the use of the highest level of 
reasoning of which the person is capable. Consequently, 
children at level 3 or 4 who sometimes respond to the first 
question as if they were at level 1 or E often "wake up" and 
apply higher levels of reasoning at this point. 
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Level 3 children Frequently utilize concepts less refined 
to explain this situation; e.g., faster, kneuu the problems 
better, etc. To the child at level 4, this example is a 
predictable example of hoiu ability increases the effectiveness 
of effort for the child who did not work hard, and limits the 
effectiveness of effort for the child luho ujorked hard. 
4!) "What would happen if they both worked really hard? If they 
did some more puzzles and they both worked hard, would one get 
more or would they both get the same? How can you tell?" 

Children at level 1 center on the obvious cue related to 
ability and indicate that hard workers will do the best. Level 
S children believe that effort is the cause of outcomes, and 
thus equal effort leads to equal outcome. Level 3 children who 
explained equal outcomes in terms of faster or better 
understanding will frequently fail to apply this differentiation 
to this question. They generally conclude that they will both 
get the same scores if they try their hardest. Children at 
level 4 recognize that the smarter child who applied little 
effort would gain most from trying their hardest. 

Si) "So, do you think one of them is smarter or are they the 
same?" 

This question is a repeat of question number S. About 
one-third of the children changed their responses from question 
S to question 5. Generally this reflected a change toward more 
mature reasoning, with two-thirds of those changing shifting to 
saying that the lazier child is smarter. Only one child out of 
30 who picked the lazier student as smarter at first asking 
changed his/her answer CNicholls & riiller, ISB^b!) . 

14 



rieasuring understanding of ability 

-14- 

It is most reasonable to assume that the less mature 
responses that occur when first asked uhich child is smarter are 
examples of performance error. The role of performance error in 
influencing our theories of qualitative change has not been 
adequately addressed from the perspective of measurement theory 
Csee Miller, March, 13B23 . If lue merely counted the mature 
responses from the adult perspective Cscore of 1 to 5D, ue might 
find results that appear to indicate a continuous Cquantitativeli 
development of improved reasoning about ability rather than a 
qualitative change in reasoning about ability. If, on the other 
hand, ue are looking for reasoning capacity, ue realize that 
people do not aluays utilize their capacity; that there is 
performance error. Thus a global scoring judgement is made 
using the information believed to best represent the persons 
reasoning capacity. Had question 1 been used as the sole source 
of our Judgement, maturity uould have been underestimated. Had 
the average or number of mature responses been used, the 
character and essence of the child's reasoning capacity ujould 
have been sacrificed. 

The analysis of individual, objective responses has been of 
interest in describing the structure of reasoning and testing 
for the influence of experimental manipulations of reasoning. 
Houever, of greatest interest and utility in a broader domain of 
research on achievement behavior is the global evaluation of 
level of reasoning about effort and ability. Generally, 
inta?r-rater agreement on global evaluation of intervieuu 
protocols has been quite high; 905^ in Nicholls, 137B; 3S"i in 
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Nicholls a Miller, 13B4b; and in Miller, 13B5 CMiller only 

distinguished levels 1 a S from 3 a . 

While some specific responses may be influenced by self 
intarest when reasoning about the self, the general reasoning 
that is applied appears to remain consistent whether reasoning 
about self or others CNicholls a Miller, 19B4b3 

Typically, level 1 predominates among five year old 
children while most: children advance to level 4 at about 11 or 
IS years. Substantial variation from one school to another in 
reasoning about about effort and ability is possible. Nicholls 
a Patashnick Cunpublished data3 found wide variations in 
portions of fifth graders capable of reasoning about ability. 
Kcwever, whether this variation is a function of population 
differences or school experiences is difficult to determine. 

Level of reasoning has been shown to be related to 
expectations of teacher approval for effort CNicholls, 137B3 . 
While less mature children expected high approval for success 
with high effort and low ability or low effort and high ability, 
mature children expected less approval for success with lew 
effort. While ratings of effort in spelling and ability were 
positively related for children below level 3, thesa ratings 
were unrelated for more mature children suggesting greater 
differentiation of effort and ability CMiller, 19BE3 . Children 
in levels 1 and E invariably prefer to be like the harder worker 
rather than the lazier student, in spite of the fact that both 
attain equal scores CNicholls et al, in press3 . while oldar 
children often express mixed feelings, they see the value of 
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heing the lazier student; "I'd like to be him Cthe lazier one). 
Then I'd work hard and do even better". 

Ego defensive performance impairment after failure occurs 
tuhen subjects reduce effort, uuithdraiu from a task, or are 
distracted out of concern for appearing loiu in ability. This 
form of performance impairment would occur when attributions to 
ability become distinguished from attributions to high effort, 
and high effort no longer implies higher ability. This form of 
performani-:e impairment after failure was found only among 
children in levels 3 & 4 Cniller, 19B5D . 

A more detailed overview of developmental changes shows 
that these findings, and the levels of reasoning about effort 
and ability are consistent with other research on age trends in 
cognition, affective responses, and behavior. For a more 
comprehensive discussion, see Nicholls & Hiller, 13a4a. 
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Appendix A 

Level 1; Effnrt or Dutcome is Ability 

Effort, ability, and Dutcame are imperfectly differentiated 
as cause and effect. Explanations are tautological. Children 
center on effort Cpeople luho try harder are seen as smarter even 
if they get a loiuer score!) or on outcome Cpeople luho get a higher 
score are said to ujork* harder — even if they do not — and are seen 
as smarter^ . 

Level 5: Eff ort is the Cause of Performance Outcomes 

Effort and outcome are differentiated as cause and effect. 
Effort is the prime cause of outcomes: equal effort is expected 
to lead to equal outcomes. Ability, in the sense of capacity 
which can increase or limit the effectiveness of effort, is not 
conceived as a cause. 

UJhen people get the same score but differ in effort, this is 
seen as due to compensatory effort by the student luho tried less 
Ce.g., she/he worked really hard for a luhile, ujorked at the end, 
might have started earlier, or must have been thinking while 
fiddling? or as due to misapplied effort by the person who tried 
harder Ce.g., she/he tried too hard or went too quickly and made 
mistakes) . 

Level 3: Effo rt and Abilitu Partially Differentiated 

Effort is not the only cause of outcomas . Explanations of 
equal outcomes following different effort involve suggestions 
such as: The person trying less is faster, brighter, has a 
better understanding, or is naturally good at the activity. 
These explanations imply the conception of ability as capacity; 
they imply that high ability can compensate for lack of effort' 
and that low ability limits the effect of effort. These 
implications are not, however, systematically followed through. 
Despite such explanations, children may assert that studsnts 
gaining equal scores after unequal effort are as smart as each 
other or that harder workers are smarter and that students would 
get the same scores if they worked as hard as each other. Level 
3 does not have a clear logic of its own in the sense that the 
others do. It has the appearance of a transition level. 

Level 4 : Abilitu is Cauacitu 

Ability and effort are clearly differentiated. Ability is 
conceived as capacity which, if low, may limit or, if high, may 
increase the effect of effort on performance. Effort and ability 
are seen as interdependent causes of outcomes; higher ability 
means that less effort is needed to achieve a given outcome and 
thusly, less effort may be taken to imply higher ability under 
some circumstances. 
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